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In answer to Ko's question raised in 1983, we show that an initial value problem 
given by a polynomial-time computable, Lipschitz continuous function can have a 
polynomial-space complete solution. The key insight is simple: the Lipschitz condi- 
tion means that the feedback in the differential equation is weak. We define a class of 
polynomial-space computation tableaux with equally weak feedback, and show that 
they are still polynomial-space complete. The same technique also settles Ko's two 
later questions on Volterra integral equations. 

Keywords: computable analysis; computational complexity; initial value problem; 
Lipschitz condition; ordinary differential equations; Picard-Lindelof Theorem; poly- 



^. nomial space. 

(N ■ 

■ 1 Introduction 

Q I Let g: [0,1] x R — )■ R be a continuous function and consider the initial value problem 



(1.1) h{0) = 0, h'{t) = g{t,h{t)), tG[0,l]. 

A well-known sufficient condition (see the beginning of Section 3 for a proof sketch) for 
this equation to have a unique solution h: [0, 1] — )■ R is that g be Lipschitz continuous (in 
its second argument), i.e., 

(1-2) \git,yo) - g{t,yi)\< Z -lyo-yil, t G [0, 1], yo, Z/i G R 

for some constant Z independent of yo, yi and t. We are interested in the computational 
complexity of the solution h under this condition. 

Our model of computation of real functions, which will be reviewed in Section 2, is 
adopted from computable analysis and is thus consistent with the conventional notion of 
computability. We formulate our main result in Section 3: the solution h of the above 
equation can be polynomial-space complete, even if g is polynomial-time computable. This 
was open since Ko (1983). The essential part of the proof is given in Section 4, where we 
construct a certain family of real functions that can be used as building blocks for the desired 
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g and h. The main idea is to regard the differential equation with the Lipschitz condition 
as a polynomial-space computation tableau with some restrictions. In Section 5, we state a 
few variants of the main theorem, two of which solve the problems about Volterra integral 
equations posed by Ko (1992). These variants are also proved using the same building 
blocks, as shown in Section 6. Section 7 discusses related results and open problems. 

2 Computational complexity of real functions 

The study of mathematical analysis from the viewpoint of computability is called com- 
putable analysis; Brattka et al. (2008) and Weihrauch (2000) are good introductions to 
the field. We review the basic definitions briefly here, refining them for our complexity 
consideration where necessary. 

The computability notion for real functions equivalent to ours dates back at least to 
Grzegorczyk (1955). Polynomial-time computability of real functions was introduced by 
Ko & Friedman (1982) using oracle machines, and is equivalent, at least in our context, to 
the one defined by the type-two machine and the signed digit representation (Chapter 7 of 
Weihrauch (2000)). 

2.1 Computing real functions 

Since real numbers cannot be encoded into strings, we encode them into functions from 
strings to strings. We say that a real number t is represented by a string function A if for 
any m G N, the string A(0™) is the binary notation (with a sign bit at the beginning) of 
either l2"^t\ or [2™t] , where |_-J and [■] mean rounding down and up to the nearest integer, 
respectively. In effect, A{Q'^) gives an approximation of t with precision 2~"* by a multiple 
of 2~"^. We also say that A is a name of t. 

Computation of real functions is realized by oracle Turing machines (henceforth just 
machines) working on such names A. In addition to the input, output and work tapes, the 
machine has a query tape and can consult an external oracle A by entering a distinguished 
state; the string v which is on the query tape at this moment is then replaced by A{v) 
in one step. We write for the string-to-string function computed by machine M with 
oracle A. 

Definition 2.1. A machine M computes a function f: [0, 1] ^ R if for any t e [0, 1] and 
any name A of it, M"^ is a name of f{t). 

Thus, computation of a real function / is a Turing reduction of (a name of) f{t) to t 
(Figure 2.1, left). A little thought shows that it can equivalently be visualized as a Turing 
machine that, given on the input tape an infinite sequence of approximations of t, writes 
approximations of f{t) endlessly on the one-way output tape (Figure 2.1, right). 

A machine runs in polynomial time if there is a polynomial p: N — )■ N such that, for 
any input string u, it halts within p(|m|) steps regardless of the oracle. A real function is 
(polynomial-time) computable if some machine (that runs in polynomial time) computes it. 

When writing an approximation of f{t) with precision 2~™, the machine knows t only to 
some finite precision 2~". Hence, all computable functions are continuous. If the machine 
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Figure 2.1: To compute a real function /, the machine should output an approximation 

of f{t) with given precision 2""* by consulting the oracle for approximations of t with any 
precision 2~" it desires (left). An alternative picture (right) is that the machine converts any 
stream of improving approximations of f to a stream of improving approximations of f{t). 




runs in polynomial time, then this n is bounded polynomially in m. Hence, all polynomial- 
time computable functions / have a polynomial modulus of continuity (Figure 2.2): there 
is a polynomial p such that |/(to) — /(^i)l < 2^"* for all to, ti G [0, 1] and m G N with 
\to-ti\ < 2-P(™) (note that in our setting it makes sense to put p in the exponent, deviating 
from some authors' terminology where a modulus of continuity means a function that takes 
an upper bound on \to — ti\ to that on |/(to) ~ ia-ct, it is not hard to see that 

polynomial-time computability can be characterized by this plus the assertion that / can 
be approximated at rationals: 

Lemma 2.2. A function f: [0, 1] — )■ R is polynomial-time computable if and only if it has 
a polynomial modulus of continuity and there is a polynomial-time computable function 
^: ([0, 1] n Q) X {0}* Q such that 

(2.3) 1^(^,0'*) -/(c^) I < 2-", rfG [0,l]nQ, nGN, 

where rational numbers are encoded in a reasonable way (e.g., using fractions whose nu- 
merator and denominator are integers written in binary). 
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Many familiar continuous functions arc computable. For example, it is easy to see that 
the sine function restricted to [0, 1] is polynomial-time computable, because an approxima- 
tion of 

f 

(2.4) sint^t-- + --- + ... 

to precision 2""^ can be found by approximating the sum of polynomially many (in m) 
initial terms, since this series converges fast enough on [0, 1]. 

The above definition can be straightforwardly extended to functions on compact inter- 
vals other than [0, 1] and on d-dimensional rectangles (by considering machines taking d 
oracles). Also, polynomial-space, exponential-time and exponential-space computability is 
defined analogously to polynomial-time computability, where by "exponential" we mean 
2" (and not 20(")). Here, wc count the query tape in when defining space complexity. 
The definition in Section 7.2.1 of Ko (1991) states to the contrary, but his subsequent 
theorems build on the definition that does charge the query tape (on the other hand, his 
argument in Chapter 4 that the query tape should not be counted in discussing logarithmic 
space is correct). 



2.2 Completeness 

We now introduce terminology to state our main results which say that certain real functions 
are "hard" to compute. We regard a language L as a set of strings or as a {0, 1}- valued 
function interchangeably, so that L{u) = 1 means u & L. We write P, NP, PSPACE, 
EXPTIME, EXPSPACE for the standard classes of languages and #P for the function 
class; see Papadimitriou (1994). 

Definition 2.5. A function L (over strings) is said to reduce to a real function h : [0, 1] — )■ 
R if the following holds for some polynomial-time computable functions R, S, T: Let u 
be a string, and suppose that the function taking string v to S{u, v) is a name of a real 
number t e [0, 1]. Then L{u) = R{u, ip{T{u))) for any name ip of f{t) (Figure 2.3). 

For a complexity class C. wc say that a real function is C-hard if all problems in C 
reduce to it. A real function is polynomial- space (rcsp. exponential-space) com^plete if 
it is polynomial-space (resp. exponential-space) computable and PSPACE-hard (resp. 
EXPSPACE-hard). 

The above definitions of reduction and completeness can be viewed as a special case of 
those by Beame et al. (1998), and are also consistent with Definition 2.2 of Ko (1992). 



3 Ko's question and our main result 

Now we return to the differential equation (1.1). The fact that (1.2) guarantees a unique 
solution is known as (a variant of) the Picard-Lindelof (or Cauchy-Lipschitz) Theorem, 
and can be proved as follows. Let C be the set of all continuous real functions on [0, 1]. A 
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Figure 2.3: L reduces to h via R, S and T. This means that, using a hypothetical machine M 
computing h (in the sense of Definition 2.1) as a black box, we can compute L in polynomial 
time in the way depicted above. 



solution of (1.1) is a fixed point of the operator T: C — > C defined by 

(3.1) T(h)(t)^ f g{r,h(r))dr, te[0,l]. 

Jo 

The existence and uniqueness of this fixed point follow from the contraction principle 

(Banach fixed point theorem), because a simple calculation shows that, for the metric d 
on C given by d{ho,hi) = max^g^,!] 6xp(— 2Zt)|/io(t) — hi{t)\, we have d{T{ho),T{hi)) < 
d{ho,hi)/2. 

We assume the following, and ask how complex h can be: 

(*) g: [0, 1] X R— )-R and h: [0, 1] —>■ R satisfy (1.1), g satisfies (1.2), and g is polynomial- 
time computable. 

Strictly speaking, we have defined polynomial-time computability only for functions on a 
compact rectangle. What we mean here is that the restriction of g to [0, 1] x [min h, max/i], 
say, is polynomial-time computable. Equivalcntly, wc could write g: [0,1] x [—1,1] — )■ R 
and add the clause "the values of h stays within [—1, 1]" to (*); this does not essentially 
change our result, because we can always make h stay within [—1, 1] by scaling g and h 
down by a constant factor, which does not affect polynomial-time computability. There is 
a way to extend Definition 2.1 to functions with unbounded domain, as in Hoover (1990) 
or pp. 57-58 of Ko (1991), but we choose our simpler definition. 

As Ko (1983) points out by analyzing the Euler method, (*) implies that h is polynomial- 
space computable. From this it follows (Lemma 2.2 of Ko (1983)) that if P = PSPACE, 
then (*) implies that h is polynomial-time computable. We will prove a lower bound that 
matches this upper bound: 

Theorem 3.2. There are functions g and h satisfying (*) such that h is PSPACE-iard 
(and thus polynomial-space complete). 
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Corollary 3.3. P = PSPACE if and only if (*) always implies that h is polynomial- 
time computable. 

This solves the main problem left open in Ko (1983). He had proved there a partial 
result essentially stating that Theorem 3.2 holds true if the Lipschitz condition (1.2) in the 
assumption (*) is replaced by a weaker condition. 

We remark that the special case of the equation (1.1) where g ignores its second argu- 
ment reduces to integration, whose complexity is summarized as follows in the style similar 
to Theorem 3.2 and Corollary 3.3. 

Theorem 3.4 (essentially by Friedman 1984). There are a polynomial-time computable 
function g: [0, 1] — > R and a ^P-hard function h: [0, 1] — > R such that 



Corollary 3.6 (Friedman 1984). P = P#^ if and only if for all polynomial-time com- 
putable g: [0, 1] — > R, the function h defined by (3.5) is polynomial-time computable. 

The relation to the counting class is not surprising: as is apparent from Friedman's 
proof, the intuition behind this result is that approximating the integral is to count the 
number of grid points below the graph of g. 

This bound of P#^ has been the best known lower bound also for our differential 
equation. Theorem 3.2 improves this to PSPACE. 

4 Proof of the theorem 

We present the proof backwards, reducing Theorem 3.2 to Lemma 4.1 and then reducing 
Lemma 4.1 to Lemma 4.7. In Section 4.1, we state Lemma 4.1 asserting the existence 
of a certain family of pairs of functions {gu)u and (/i„).u, from which the functions g and 
h in Theorem 3.2 can be constructed. Section 4.2 shows that Lemma 4.1 follows from 
Lemma 4.7, which asserts the PSPACE-completeness of a discrete version of the initial 
value problem. This discrete problem is hke a PSPACE computation tableau, but with a 
certain restriction similar to the Lipschitz condition. Section 4.3 then completes the proof 
by showing Lemma 4.7. 

4.1 Building blocks 

To state Lemma 4.1, we need to extend the definition of computation in Section 2.1 to 
families of real functions indexed by strings u. This is done in the natural way, by giving u 
as another string input to the machine. For example, a family {gu)u of functions gu '■ [0, 1] x 
[— 1, 1] — >■ R is computed by a machine M if for any names A and B oi t e [0, 1] and 
y e [—1, 1], the function that takes string 0™ to M^'^(m,0"') is a name of gu{t,y). Note 
that in this case, claiming that M runs in polynomial time means that it halts in time 
polynomial in \u\ + m. 



(3.5) 
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Figure 4.1: To construct g, we assign interval [l^ , to each string m and put there a pair of 
reduced copies of g^- The value /i(c„) at the midpoint will be positive if and only if u G L. 



Lemma 4.1. Let L e PSPACE and iet A: N -)• N be a polynomial. Then there exist a 
polynomial p: N — > N and families of functions Qu ■ [0, 1] x [—1, 1] — > R and hu : [0, 1] — > R 
indexed by binary strings u such that the family {gu)u is polynomial-time computable and 
for each u we have 

(i) K{t) e [-1, 1] for all t e [0, 1]; 

(ii) gu{0, y) = ^n(l, y) = for all y e [-1, 1]; 

(Hi) hM = and h'St) = guit, for all te[0,l]; 

(iv) \gu{t, yo) - Quit, yi)\ < 2-^(l"l)|2/o - yi\ for any t e [0, 1] and yo, yi G [-1, 1]; 

(v) /i„(l) = 2-^(H)L(ii). 

We thus have a family of functions gu that each give an initial value problem whose 
solution hu encodes L{u) in its final value /i„(l). 

Using this family, the functions g and h in Theorem 3.2 will be constructed roughly 
as follows. Divide [0,1) into infinitely many subintervals one for each u, with 

midpoints c^. We put a pair of scaled copies of gu onto [^^,c„] and [c«,/J] as shown 
in Figure 4.1 so that the membership of w in L can be determined by looking at /i(c„). 
Scaling down g^ horizontally increases its Lipschitz constant, and the resulting g needs to 
have a Lipschitz constant independent of u; this is why we had to claim in (iv) that the g^ 
originally have small constant 2~'*'(l"l\ Details are routine and are relegated to Section 6 
along with the proofs of two other theorems which will be stated in Section 5 and which 
will also follow from Lemma 4.1. 

4.2 Discrete initial value problem and the Lipschitz condition 

A first attempt to prove Lemma 4.1 would be as follows. Consider a polynomial-space 
Turing machine that decides whether a given string u belongs to L. Its configuration 
at each time can be encoded into a nonnegative integer less than 2'-^*^'"l\ where C is a 
polynomial. There is a simple rule that maps u (the input), T (time) and d (the current 
configuration) to a number Gu{T, d) (the next configuration) such that the recurrence 

(4.2) Hu{0) = 0, Hu{T + 1) = Gu{T, HuiT)) 
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Figure 4.2: An attempt to simulate a polynomial-space Turing machine by an initial value 
problem is to encode the machine configuration Hu{T) at each time T into the value hu{t) = 
if„(r)/2'^(l"l) at time t = r/2Q(l"l). 



leads to i7u(2'^(l"l)) = L{u) for some polynomial Q. Now this situation looks similar to the 
one in Lemma 4.1: starting at 0, the value of Hu (or hu) changes over time according to 
a simpler function Gu (or g^), to reach a value eventually that indicates the answer L{u). 
Thus we are tempted to simulate the "discrete initial value problem" (4.2) by embedding 
each value i/„(T) as real number i7„(T)/2^(l"l) (Figure 4.2). 

The obstacle to this attempt is that the differential equation (iii) in Lemma 4.1 cannot 
express all discrete recurrences of form (4.2): continuous trajectories cannot branch or 
cross one another; besides, we have the Lipschitz condition (iv) that puts restriction on how 
strong the feedback of h to itself can be. We thus need to restrict the discrete problem (4.2) 
so that it can be simulated by the continuous version. 

To do so, let us reflect on what the Lipschitz condition (iv) means. A rough calculation 
shows that if two trajectories differ by s at time t, then they can differ at time t + 2~'^'-l"'^ 
by at most eexp(2-^(l"l)2-'3(l"l)) ^ ^(1 + 2-^(l«l)-0(l«l)). Thus, the gap can only widen (or 
narrow) by a factor of ±2~'^*^l"l)~'^*^l"l^ during each time interval of length 2~'^*^l"l\ In other 
words, the feedback caused by equation (iii) is so weak that each digit of hu can only affect 
far lower digits of hu in the next step. 

Now we deflne a discrete problem that reflects this restriction. Let P and Q be poly- 
nomials and let 

(4.3) G„:[P(|«|)]x[2«(H)]x[4]^{-l,0,l}, 

(4.4) Hu-. [P{\u\) + 1] X p'^d"!) + 1] ^ [4], 
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Figure 4.3: The discrete initial value problem (4.3)-(4.6). Each cell HuiT) in Figure 4.2 is 
now divided into Hu{0,T), . . . , Hu{P{\u\),T); the increment from Hu{i + 1,T) to + 
l,r + 1) is computed by Gu using the upper left cell Hu{i,T). 



where we write [N] = {0, . . . , — 1} for A'" e N. Our restricted discrete initial value 
problem is as follows: 

(4.5) H^{t,0) = H.,{0,T) = 0, 

(4.6) H^{i + 1, T + 1) = H^{t + 1, T) + G^{i, T, H^{i, T)) . 

Thus, Hu{T) of (4.2) is now divided into polynomially many (in \u\) components i?u(0, T), 
. . . , Hu{P{\u\),T); compare Figures 4.2 (bottom) and 4.3. We have added the restriction 
that Gu sees only the component Hu{i,T), which in Figure 4.3 means the upper left of 
the current cell. The following lemma states that, despite this restriction, we still have 
PSPACE-completeness. Note that making Gu completely oblivious to its last argument 
would be an overkill, because then Hu would just add up the values of Gu, resulting in the 
complexity merely of 7^ P. 

Lemma 4.7. Let L e PSPACE. Then there axe polynomials P, Q and families {Gu)u, 
{Hu)u satisfying (4.3)-(4.6) such that {Gu)u is polynomial-time computable and Hu{P{\u\), 
2'3(l"l)) — L{u) for each string u. 

Before proving this, we will reduce Lemma 4.1 to Lemma 4.7 by simulating the new 
system (4.3)-(4.6) by the differential equation. Using Gu and Hu of Lemma 4.7, we will 
construct (?„ and hu of Lemma 4.1 such that /i„(T/2'^*^'"''') = Hu{i,T)/ for each T, 
where 5 is a big number. Thus, each column in Figure 4.3 will be encoded into one real 
number so that upper/lower cells in the column correspond to upper/lower bits of the 
real number. Thanks to the restriction that G„ sees only the upper row, the differential 
equation h'^{t) = gu{t,hu{t)) only needs to cause a weak feedback on hu where each bit 
of the value of hu affects only much lower bits of its next value. This keeps Qu Lipschitz 
continuous. Now we fill in the details. 
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Proof of Lemma 4.1. Let P, Q, ((?„)„, be as in Lemma 4.7. By "dividing each 

unit time into -P(|m|) steps," we may assume that for each T, there is at most one i such 
that Gu{i,T,Y) ^ for some Y . Write J„(T') for this unique % (define ju(T) arbitrarily if 
there is no such i). We may further assume that 

(4.8) i/„(z,2«(H)) = |^("^ = 

^ ^ ^ \0 \i%<P{\u\). 

Thus, not only docs the bottom right corner of Figure 4.3 equal Liu)^ as stated already in 
Lemma 4.7, but wc also claim that the other cells in the rightmost column are all 0. This 
can be achieved by doubling the time frame and extending G symmetrically so that in the 
second half it cancels out what it has done. Precisely, we extend G„ by 

(4.9) G„(z,2-2«(N)-i-r,r)=.|° , ^ ifi = P(M)-i, 

^ ^ ^' ' ^ \-G^{i,T,Y) \ii<P{\u\)-\ 

for (i,T,F) e {P{\u\)\ X [2«(l"l)] x [4], and iJ„ by 

(4.0, ..(>.2.2«N.-r)J^"(-^;l).^'«) «^-;<H). 

\E^{i,T) \i%<P{\u\) 

for (i,r) e \Pi\u\) + 1] X [2'?(l"l) + 1], and then add 1 to Qi\u\). It is easy to verify that 
the equations (4.5) and (4.6) are still satisfied. 

Now, assuming (4.8), we construct the families i^g^u and (hu)u of Lemma 4.1. For each 
string u and each {t,y) e [0, 1] x [-1, 1], let T e N, ^ G [0, 1], F G Z, e [-1/4,3/4] be 
such that t = {T + ^)2-'3(l«l) and y = (Y + ri)B-^^^^\ and define 



3-4r;/ Y \ 47]-l f Y + l\ 1 
-9u t, „ . + — - — TT-T^n if ^^7' 



(4.11) ^„(t,y) 

, _ 1 - cos(g7r) G„(j.(T),T,ff.(j„(T),T)) /^^ g,(z,T) 

i=0 

where B = 2'^*^l"l''+'2*^l"l)+^. Note that the second branch of (4.11) says that when 77 G 
[1/4,3/4]. wc define gu{t-y) by interpolating between the nearest two y at which Qu is 
already defined by the first branch. Equation (4.12) says that, when 9 = (i.e., t is a 
multiple of 2~'5^l"l)), the value hu{t) is the real number that encodes the Tth column of 
Figure 4.3; as 6 goes from to 1, it moves to the next value along a cosine curve, whose 
slope, as we will see below, matches the sine function in the first branch of (4.11). It is easy 
to verify that the definition is consistent; in particular, we use (4.6) to show that (4.12) 
stays the same for the two choices of (T, 9) when t is a multiple of 2^*5'^l"i^. 

Conditions (i) and (ii) of Lemma 4.1 are easy to verify. We have (v) with p{k) = 
P(A;)(A(A;)+Q(A;)+5), since /i„(l) = /J„(P(|«|), 2^(H))/5^'(H) = L(m)/B^(I"I) = L(m)/2''(H) 
by (4.12) and (4.8). Checking the polynomial-time computability of {gu)u is also routine, 
using Lemma 2.2. 
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To see (iii), observe that in the right-hand side of (4.12), 

o the absolute value of the first term is bounded by < B~^^^'^^ /32, 

o the summands corresponding to i < ju{T) are multiples of B~^'^^'^\ and 

o the summands corresponding to i > ju{T) are nonnegative numbers, each bounded by 
3/B' = 3S-^"(^)/S^-^"(^) < 3S-^"(^)/32^-^"(^), and thus altogether by 3S-^-(^)/31. 

Hence, we can write hu{t) = {Y + 7])B'^"^'^^ for some r] G [—1/4, 1/4], where 

(4.13) ^=Y1 ^) ■ B^^^'^^-\ 

Since S is a multiple of 4, we have Y mod 4 = Hu{ju{T),T). Substituting these Y and rj 
into (the first branch of) (4.11), we get 

(4.14) gu{t,K{t)) = 3^,„(THi ' g^{ju{T),T,HMT),T)). 

This equals h'^{t) calculated from (4.12). 

For the Lipschitz condition (iv), note that since the value of Gu in the first branch of 
(4.11) is in {—1,0, 1}, the difference between the two values of Qu in the second branch 
is bounded by 2 x 2Q(l"l)7rsin(^7r)/(25^"('^)+i) < 2'3(l«l)+2/S^-(r)+i. Thus, the slope of 
along the second argument is at most 

by our choice oi B. □ 
4.3 The discrete initial value problem is hard 

It remains to prove Lemma 4.7. At first sight, our system (4.3)-(4.6) (Figure 4.3) looks too 
weak to simulate a polynomial-space computation: although we have polynomial amount 
of memory (rows) and exponential amount of time (columns) , the "chains of dependence" 
of values must run from top to bottom and thus are polynomially bounded in length. 

Thus, we give up embedding a general PSPACE computation into Figure 4.3. Instead, 
we embed another PSPACE-complete problem, qbf (quantified boolean formulas, see 
Papadimitriou (1994) where it is called QSAt), which asks for the truth value of the given 
formula u of form 

(4.16) QnXn ■ ■ ■ QlXi. ij{xi, ...,Xn), 

where ip is a boolean formula and Qi G {V, 3} for each i = 1, . . . , n. 

The truth value of (4.16) is obtained by evaluating a binary tree of depth n whose 
2" leaves each correspond to an assignment to {xi, . . . ,Xn) and whose internal nodes at 
level i are labeled Qi. This is roughly why it can be simulated by the tableau in Figure 4.3 
despite the restriction that the dependence of values must run from top to bottom. We 
give a formal proof and then an example (Figure 4.4). 
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Proof of Lemma 4.7. We may assume that L = qbf. We will construct the polyno- 
mials P, Q and families {Gu)u and {Hu)u in Lemma 4.7. Let u be of form (4.16). For each 
i — 0, . . . , n and n — i bits bi+i, . . . , 6„ e {0, 1}, we write ipi{bi+i, . . . , 6„) e {0, 1} for the 
truth value (1 for true) of the subformula QiXi . . . QiXi. ip{xi, . . . ,Xi, . . . ,bn), so that 
j/jQ — ip and '0n( ) — QBf(k). We regard quantifiers as functions from {0, 1, 2, 3} to {0, 1}: 

(4.17) V(2) = 3(2) =3(1) = 1, 3(0) = V(0) = V(l) = 

(the values V(3) and 3(3) do not matter). These correspond to the meaning of the quan- 
tifiers: Vx (resp. 3a;) means that the subsequent formula is satisfied by 2 (resp. 1 or 2) of 
the two possible assignments to x. Thus, 

(4.18) Qi+i{lpi{0, bi+2, ...,bn)+ ipiil, bi+2, &n)) = 1pi+libi+2, ■■■,bn) 



for each i = 0, .... n — 1. For 2n + 1 bits bo, . . . , b2n £ {0, 1}, we write ■ ■ ■ ^'o for the 

number bo + 2bi + 2%2 H h 2^'^b2n- 

To define G^, let 



(4.19) G^{i, T2nT2n-l ■ ■ ■ r2i+2r2,+ilOO . . . 0, F ) 

= (-l)^2,+2 X /"^O^^l ® ^3 © T4, . . . , T2„_i © T2n) if i = 0, 

l(5i(^) otherwise, 

where © denotes the exclusive or; let Gu{i,T,Y) = for other T (that is, when T is not 
an odd multiple of 2^*). Define Hu from G„ by (4.5) and (4.6). 

We prove by induction on i = 0, n that Hu{i,T) e {0,1,2} for all T, as we 
mentioned earlier, and that 



(4.20) Gu{i, S, Hu{i, S)) = {-lf'^+'iPi{S2i+i © S2i+2, S2n-i © S: 



2n 



for all S of form 5'2„S'2„_i . . . S'2i+il00 ... (it is immediate from the definition of Gu that 
Gu{i, S, Hu{i, S)) = for other S). Once we have proved this, the case i = n yields 
G'„(n,22",i/„(n,22")) = ^^() = qbf(m), and hence H^{n + 1,2^" + 1) = QBf(m). Since 
n < \u\, we can add dummy rows and columns so that i7„(P(|M|), 2'3(l"l)) = QBf(m) for 
some polynomials P and Q, as required. 

The claims for i = follow immediately from (4.5) and (4.19). Now suppose (4.20) as 
the induction hypothesis and fix T = r2„T2„_i . . .Tq. Let Y = Hu{i + 1,7"). By (4.5) and 
(4.6), we have 

T-l 

(4.21) y = ^G'„(^,^,i/„(z,5)). 

5=0 

Since the assumption (4.20) implies that flipping the two bits 821+2 and 5*21+1 of any 
-S" — S2nS2n-\ ■ ■ ■ So reverses the sign of Gu{i, S, Hu{i, S)), most of the nonzero sum- 
mands in (4.21) cancel out. The only terms that can survive are those that correspond 
to S = T2nT2n-i ■ ■ ■ Tsi+gOOlOO . . . and S = r2„r2„_i...r2i+301100...0. This proves 

ye {0,1, 2}. 
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T: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 
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Figure 4.4: The discrete initial value problem (4.3)-(4.6) corresponding to the formula 
u = 3x2.Vxi.(xi V X2)- We follow the convention in Figure 4.3 (but omit the top cells 
Hu{0,T) which are always 0): the cells contain Hu{i,T), and the signed number above the 
cell Hu{i + l,r) indicates the increment Gu{i,T, Hu{i,T)) (which is when omitted). The 
increments G„(0,T, 0) for the top row are determined by the truth values of xi V X2 for 
various assignments to {xi,X2)- 



When T — T2nT2n-\ ■ ■ ■ 22i+3l00 ... 0, both of these terms survive, so that 

(4.22) Y = V.(0, T2,+3 © T2,+4, • . • , T2n-1 © T2n) + ^i(l, T2,+3 © T2 

Therefore, Qi+iiY) = V^i+i(T2i+3 © T2i+4, . . . , T2„_i © T2„) by (4.18). Thus, 

(4.23) G^{x + 1, T, Y) = (-l)^«+*V^+l(^2^+3 © r2,+4, ■ ■ ■ , ^2,-1 © ^2^) 

by (4.19), completing the induction step. □ 

Figure 4.4 shows the table when u be the formula 3x2.Vxi.(xi V X2). The values 
Gu(0, T, 0) encode (redundantly) the truth table of the matrix ,Ti V,X2 (first branch of (4.19)). 
For example, Gu{0,T,0) = ±1 (resp. 0) for T = 3,5,27,29 (resp. 1,7,25,31) because 
{xi,X2) = (1,0) (resp. (0,0)) makes Xi V X2 true (resp. false). Also observe that if„(l,T) 
returns to every eight cells. As a result, the cell i/u(l,4) = 1 (resp. i/„(l, 12) = 2) 
represents the fact that when X2 is false (resp. true), xi V X2 is satisfied by one (resp. two) 
of the assignments to Xi. Now look at the next row. The second branch of (4.19) says that 
for odd multiples T of 4, the values ^^(l, T, Hu{l,T)) are ±1 or according to whether the 
upper left cell has a 2 or not. Thus, they encode the smaller truth table for the subformula 
\/xi. {xi V X2) under each assignment to X2- As a result, the cell i?u(2, 16) = 1 indicates 
that this subformula is satisfied by one of the assignments to X2, which causes the last row 
to get incremented at T = 17. Observe that the final cell i?„(3, 32) has a 1, exactly because 
u is true. 

5 Other versions of the problem 

5.1 Complexity of the final value 

Ko (1983) discusses another version of the question which relates the complexity of the 
value h{l), rather than the function h, to that of tally languages (subsets of {0}*). 
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Definition 2.5 extends straightforwardly to macliines taking d oracles. In particular, 
the case d = means that a language L is said to reduce to a real number t if there 
are polynomial-time computable functions R and S such that L{u) — R{A{S{u))) for any 
string u and any name A of t. Now we can state: 

Theorem 5.1. For any tally language L e PSPACE, there are functions g and h satis- 
fying (*) such that L reduces to h{l). 

This can be proved by arranging the building blocks from Lemma 4.1, as we did for 
Theorem 3.2, but in a different way. See Section 6.2 for details. 

As a corollary to Theorem 5.1, all tally languages of PSPACE are in P if (*) imphes 
that h{l) is polynomial-time computable. This improves on Theorem 4 of Ko (1983), which 
showed the same thing with the Lipschitz condition replaced by a weaker condition. 

5.2 Volterra integral equations 

Ko (1992) later studied the complexity of Volterra integral equations of the second kind 



where function h is to be solved from given / and g. As before, we suppose that / and g 
are polynomial-time computable and ask how complex h can be. 

If g is Lipschitz continuous (in its last argument), h is polynomial-space computable 
by Picard's iteration method (Section 3 of Ko (1992)). On the other hand, the best lower 
bound (in the sense analogous to the "if" direction of Corollary 3.3) has been P*^. One 
of the two open problems in Ko (1992) was to close this gap. Our Theorem 3.2 has solved 
it, because the initial value problem (1.1) is the special case of (5.2) where / is constantly 
zero and g ignores its first argument: 

Corollary 5.3. There are functions f: [0, 1] ^ R and g: [0, 1] x [0, 1] x R ^ R such 
that g is Lipschitz continuous (in its last argument), f and g are both polynomial-time 
computable, and the (unique) solution of (5.2) is polynomial-space complete. 

The other problem was about the following weak version of the Lipschitz condition (1.2): 



(5.4) \g{t,yo)-g{t,y^)\<2'^''^\yo-yi\, n e N, te[Q,l-2-% yo,yieR, 



where r is a polynomial. Assuming (*) with (1.2) replaced by (5.4), how complex can h 
be, provided it has a polynomial modulus of continuity? Ko (1992) asked this question for 
the Volterra equation (5.2) (in which case the g in (5.4) takes one more argument), and 
showed that h is exponential-space computable and can be EXPTIME-hard. His second 
open problem was to close this gap. 

The motivation for this problem comes from Volterra integral equations of the first kind, 
a class of equations that are considered harder to solve than (5.2). A common approach 
to solve them is to convert the equation into the form (5.2). This conversion does not 



(5.2) 
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preserve Lipschitz continuity (1.2); the new equation merely satisfies (5.4). See Ko (1992) 
for details. 

The following theorem settles this problem (see Section 6.3 for a proof, again using 
Lemma 4.1). In fact, we have EXPSPACE-completeness even for the simple differential 
equation (1.1): 

Theorem 5.5. There are functions g and h satisfying (*) with (1.2) replaced with (5.4) 
such that h has a polynomial modulus of continuity and yet is EXPSPACE-iiard. 

Note, however, that this theorem says nothing directly about the complexity of Volterra 
equations of the first kind. It merely addresses the complexity of a class of equations that 
may arise in a particular approach to solving them. 



6 Putting the building blocks together 

We give the details of the proofs of Theorems 3.2, 5.1 and 5.5 from Lemma 4.1. 
6.1 Proof of Theorem 3.2 

The rough ideas are explained in Section 4.1. Let L be a PSPACE-complete language. Use 
Lemma 4.1 for A(A;) = 2A; + 2 to obtain polynomial p and families {gu)u, {hu)u- Since {gu)u 
is polynomial-time computable, there is a polynomial 7 satisfying \gu{t-i y)\ < 2'^''-'''^^"^"'. For 
each binary string u, let = 2^(l"l), r„ = 2^(1"!) and 

(6.1) ^"=1-^+^' ^^-^'-^h 

where u e {0, . . . , 2l"l - 1} is u read as an integer in binary notation. This divides [0, 1) 
into intervals [/~, /J] indexed by m e {0, 1}*. Define 

(6.2) Jii±' y\-^>>4t,y) 



(6.3) A /I± 



A ' A r r 

t \ hu{t) 



for each t e [0, 1] and y e R, where y — max{— 1, min{l, y}}. Let g{l,y) — h{l) — for 
each y G R. These define g and h "seamlessly" by Lemma 4.1(ii). 

We show that g and h satisfy (*). We begin with equation (1.1). It is easy to see that 
h{0) = and h'{l) = = ^'(1, h{l)). Since any number in [0, 1) can be written in the form 
/J ± t/ Au for some u and t G [0, 1], we have (1.1) by 

(6.4) ,.(i^^±)^^m^i?'(''f^m) 



Air r 



A A r \ A \ A 
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where equalities are by (6.3), (iii), (6.2), (6.3), respectively. 

The Lipschitz condition (1.2) is satisfied with Z = 1 by (iv) and our choice of A. To 
see that g is polynomial-time computable, we use (the obvious two-dimensional version of) 
Lemma 2.2. When asked for a 2~"^-approximation of g(T,Y) for rational numbers T and 
Y, the machine can find u, ±, t, y with {T,Y) = (/J ± t/ylu, i//ylu/^„) in polynomial time, 
bmce (6.2) lies in [-2-l"l, 2-l"l], the machine can safely answer if m < Otherwise it 
can answer by computing gu{t, y) with precision 2"™, which can be done in time polynomial 
in m -|- |u| < 2m by the polynomial-time computability of {gu)u- 

We have thus proved (*). Since 

(6.5) Mc«) ^"^'^ "^^"^ 



AuFu 2^(l"l)+'^(l"l)+''(l"l) 



by (6.3) and (v), the problem L reduces to h. More precisely, the functions R, S, T in 
Definition 2.5 can be given by 



(6.6) R{u,v) 



if V denotes 0, 

1 if V denotes 1, 

(6.7) S{u, 0"") = a string denoting [2"c„J , 

(6.8) T{u) = 0^(M)+'r(M)+p(M) , 

Since L is PSPACE-complete, so is h. 



6.2 Proof of Theorem 5.1 

We will construct g and h satisfying (*) such that the tally language L G PSPACE reduces 
to h{l). Apply Lemma 4.1 to A(A;) = A; -|- 1 to obtain the polynomial p and the families 
{9u)u, {hu)u- As we did for Theorem 3.2, we are going to divide [0, 1) into countably many 
intervals [Z^, Zfe+i] and put there some copies of the block g^k of Lemma 4.1; but this time, 
we do not put the mirror reflection to bring h back to (Figure 6.1). The values /iu(l) pile 
up, so that we can recover any of them by looking at h{l). 

Since {gu)u is polynomial-time computable, there is a monotone polynomial 7 : N ^ N 
satisfying \gQk{t,y)\ < 2'^^^'' for each k. Let 4 = 1 — 2"^^ and define 

(6.9) gL+ ' a,.(t,y) 



^ / K=0 

for each k e N, t e [0, 1], y e [-1, 1] and j e Z, where p(A;) = p(0) H \- p{k - 1). 

Complete the definition by g{l,y) — and 

°° L(O^) 

(^■^^^ ^ XI 22fe+7(fc)+P(fe)+P(fe) ■ 

k=0 
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Figure 6.1: Compare with Figure 4.1. The blocks gQk are now stacked vertically so that the 
tally language L can be recovered from h{l). 



By (6.11), the language L reduces to h{l). 

We show that these g and h satisfy (*). Well-definedness and Lipschitz continuity of g 
follow from (ii) and (iv) of Lemma 4.1, similarly to the proof of Theorem 3.2. Polynomial- 
time computability also follows from that of {gu)u again. Since all terms under the sum- 
mation symbol in (6.10) are divisible by 4:/2'^''~^"'^''^~^^^''\ substituting (6.10) into the second 
argument of (6.9) yields 

.f,,^. (j ,_L h(i ^-L\\ _ 9AtMt)) _ K^i^) _u>(i , t \ 

where the second and third equalities are by (iii) and (6.10), respectively. This and h'{l) = 
= g{h{l)) yield (1.1). We have proved (*). 

6.3 Proof of Theorem 5.5 

Let L G PSPACE be the set of triples (M, x, O'*) such that M encodes a Turing machine 
that, on string input x, uses at most s tape cells and accepts. For each triple w — (M, x, s), 
let Uw = (M, X, 0*). With a suitable encoding, we have \uw\ < 2l"'l. It is easy to see that 
L' = {w: u,^ e L} is EXPSPACE-complete. 

The desired g and h such that L' reduces to h will be constructed as follows. As we did 
for Theorem 3.2, we divide [0, 1) into infinitely many intervals [l^, l^] with midpoints c^, and 
put there the functions gu^ of Lemma 4.1 to compute whether & L, which is equivalent 
to w G L'. But this time, the outcome hu^{l) is exponentially small in \w\ (even when 
it is positive), so we need "amplifiers" to make the value h{cyu) visibly large (Figure 6.2). 
Because we use stronger and stronger amplifiers as — )■ oo, the function g will not satisfy 
the full Lipschitz condition (1.2), but it still satisfies the weaker condition (5.4). 

Now we fill in the details. Apply Lemma 4.1 to X{k) — (and the above L) to obtain 
the polynomial p and families ((?„)„, {hu)u- Since {gu)u is polynomial-time computable, 
there is a polynomial 7 satisfying \gu{tiy)\ ^ 2'''*^I"I)~I'*L We may assume that 7(A;) — A; is 
strictly increasing in k and that (1.51n2)7(A;) < 2'^^^^~'^ for all k. For each binary string w. 
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J 



















a copy of another copy of g^^ (mirrored) 

Figure 6.2: The construction for Theorem 5.5 is similar to Figure 4.1, but this time we put 
an "amplifier" in the middle. Then w ^L\i and only if h{cu,) is positive, and in this case it 
is only polynomially small in \w\. 



let = 22|-l+^ = 2^(2""') and 

(6.13) c^ = l- — + — , aJ = c^T— , l^^c^^—, 

Zl I /l^ Jlyj /lyj 

where w e {0, . . . , 2l^l - 1} is w read as an integer in binary notation. This divides [0, 1) 
into intervals [l~, Z+] of length 4/yl^„ indexed by w e {0, 1}*. Define 

(6.14) 9(l^±^, ' \_^9uAt,y) 



A A r r 

(6.15) g{^al±-^,Y^ = ±Qt{l - t)Y A^lnF^, 

(6.16) ^0^±7r) = x#' 



\ -^w ) -^w^w 

for each t G [0, 1] and F G R, where y = max{ — 1, min{l, y}}. Let g{l, Y) = h{l) = for 
each y G R. This defines g and h seamlessly by Lemma 4.1(ii). Recall the idea explained 
in Figure 6.2: the equations (6.14) and (6.16) are analogous to (6.2) and (6.3) in the proof 
of the main theorem, and (6.15) and (6.17) stand for the magnifier. 
Wc show that g and h satisfy (*) with (1.2) replaced by (5.4). 

For the equation (1.1), it is again easy to see that h{0) = and h'{l) = = g{l, h{l)). 
Numbers in [0, 1) can be written either as ± t/A^ or as ± t/A^, and for them the 
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equation follows respectively by 

(6.18) M =±!%(!)=±.^-(^'^-(^)) 



A r r 



W 



(6.19) h'(a- ±1-)= ± '"'-"""^- 



. ^, t ri^'-''^KM) \ f ^, t / t 



A ' AT / A '■"\'^w ^ A 

where we used (6.16), (iii), (6.14), (6.16), (6.17), (6.15), (6.17) for each equality. 

The condition (5.4) is satisfied with r{k) — 2k + 3 + s{k), where s is any polynomial 
such that 2^('=) > (1.51n2)7(2'=). For if T e [l', a'] or T e [a+, 1+] for some w, then by (iv) 
and (6.14), we have 

(g^^j b(r,yo)-,(r,y.)| ^ ^ ^ < 2'<i«i). 

If T e [a~, a+] for some w, then by (6.15) we have 

(6.21) lg(^.|^o)-^(T,ri)| ^ 22|«;|+3 . 15 1^ 
1^0 ~ Yi\ 

= 22|"'l+^ • 1.57(2'"'') ln2 < 2^l"'l+^ ■ 2'(l"'l^ = 2''(l'"l). 

To sec that g is polynomial-time computable, we use the characterization in (the obvious 
two-dimensional generalization of) Lemma 2.2. Suppose we are asked for an approximation 
of c/(T, Y) to precision 2"" for some T e [0, 1] n Q and Y e [-1, 1] n Q. We first find a 
string w and i e [0, 1] n Q such that T can be written as ± t/ Ayj or as ± t/ Ayj. In 
the latter case, it is easy to compute the desired approximation using (6.15). In the former 
case, we use (6.14) as follows: 

o If m < 2l"'l, we can safely answer 0, because the value (6.14) is in [_2-2'"'' ^ 2""^'""'] by 
\9ujt,y)\ < 2^(l"-l)-l"-l < 2^(2'"'')-2i"'i. 

o Otherwise, we compute y e Q, where y — A^F^/Y, and then get the desired approx- 
imation of (6.14) by computing gu^it-iV) to an appropriate precision. This can be 
done, by the polynomial-time computability of {gu)u, in time polynomial in m and 
\uu,\- But this is in fact polynomial in m, since \uu,\ < 2l"'l < m. 

We have thus proved (*) with (1.2) replaced by (5.4). Since (6.17) yields 



(6.22) h{c^) 



A^ 22|"'l+3+P(l"'l) ' 



the language L' reduces to h. Since L' is EXPSPACE-complctc, h is EXPSPACE-hard. 

Finally, we claim that h has a polynomial modulus of continuity. Precisely, we show 
that \h{To) - h{Ti)\ < 2-^ whenever A; e N and < Ti - Tq < 2-^(*=)-^ 
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o If Ti > 1 - 2-^, then Ti G [C C] some w of length > k, so \hi{Ti)\ < Ij < 
l/2'^k+3 (6.16), (6.17) and (i). Applying the same argument to Tq > Ti-2-^W-'= > 
1 _ 2-('=-i), we obtain |/ii(ro)| < l/22('=-i)+3. Thus, |/i(ro) - ^(^i)! < \h{To)\ + 
\h{Ti)\ < 1/22^+3 + i/22(fe-i)+3 < 2-^ 

o If Ti < 1 — 2^'^, then each point T G [Tq, Ti] belongs to [/~, for some w of length 
< A;. If T G [C a^] U [a+, /+], then \h'{T)\ < 2T(l""'l)/r^ < 1 by the first line of (6.18); 
otherwise, \h'{T)\ < 6(1/4) (In r^)/i„„(l) = (1.5 ln2)7(2l"'l)/i„^(l) < 2^(l"'l) < 2"^ by 
the first line of (6.19). We thus have \h'{T)\ < 2'^^\ and hence |/i(ro) - h{Ti)\ < 
2^(''')(Ti — To) < 2*'^'^^ • 2~*(^)~'^ = 2~^. 

7 Related results and open problems 

7.1 Other results on differential equations 

Table 7.1 summarizes what is known about the computability and complexity of the initial 
value problem (1.1) in our sense. Computability of other aspects of the solution is dis- 
cussed by Cenzer & Remmel (2004), Graga et al. (2008) and Kawamura (2009a). Edalat 
& Pattinson (2004) give a domain-theoretic account for the problem. 

The status between the last two rows of Table 7.1 remains open. What happens, for 
example, if we assume that g is infinitely often differentiable? 

Computability (or not) of other classes of differential equations is studied by Pour- El & 
Richards (1981), Pour-El & Zhong (1997), Gay et al. (2001), Weihrauch & Zhong (2002), 
Weihrauch & Zhong (2006) and Zhong (2007). Less is known about their computational 
complexity. 



Table 7.1: Assuming that g is polynomial-time computable, how complex can the solution h 
of (1.1) be? 



Assumptions 


Upper bounds 


Lower bounds 


None 




can be (non-unique and) all non-computable: 
Aberth (1971), Pour-El & Richards (1979), 
Ko (1983) 


h is the unique 
solution 


computable: Osgood (1898), 
Pour-El & Richards (1979) 


can take arbitrarily long time: Miller (1970), 
Ko (1983) 


condition (5.4) 


exponential-space: Ko (1992) 


can be EXPSPACE-hard (our Theorem 5.5) 


the Lipschitz 
condition (1.2) 


polynomial-space: Ko (1983) 


can be PSPACE-hard (our Theorem 3.2) 


g is analytic 


p olynomial-time : 

Ko & Friedman (1988), 

Kawamura (2010a) 
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7.2 Constructive versions 

A reasonable criticism about the results in Table 7.1 is that they deal with the complexity 
of each single solution h, whereas the practical concern for numerical analysts would be the 
complexity of the operator that "computes h from g." For comput ability, such constructive 
formulation is possible through a suitable representation of the function space (see Chap- 
ter 6 of Weihrauch (2000)). For complexity, formulation of constructive results requires 
some more ideas, and is undertaken in a recent work of Kawamura & Cook (2010b). 
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